Rapid implementation of a medical student rotation in health systems operations and remote patient care in response to COVID-19.

Medical schools initially removed students from clinical rotations at the outset of COVID-19 for safety reasons when students were eager to help and health systems needed personnel. In response, we rapidly implemented an innovative 2-week rotation for medical students to participate in health systems operations and care through remote efforts including triage and resource allocation. The curriculum also contained online self-paced educational modules covering topics including ethics, crisis standards of care, and modeling. As the health system needs shifted, so too did learners' work. One hundred and twenty-five 3rd and 4th-year students completed the experience over 10 months. Learner satisfaction, confidence, and knowledge assessed through pre- and post-rotation surveys showed statistically significant and educationally meaningful improvement. A near uniform change greater than 1 point (on a 5-point scale) was demonstrated upon rotation completion. Blending health systems and educational structures to meet the needs of both creates unique opportunities to educate students in new ways.

A 12-hospital prospective evaluation of a clinical decision support prognostic algorithm based on logistic regression as a form of machine learning to facilitate decision making for patients with suspected COVID-19.

OBJECTIVE: To prospectively evaluate a logistic regression-based machine learning (ML) prognostic algorithm implemented in real-time as a clinical decision support (CDS) system for symptomatic persons under investigation (PUI) for Coronavirus disease 2019 (COVID-19) in the emergency department (ED). METHODS: We developed in a 12-hospital system a model using training and validation followed by a real-time assessment. The LASSO guided feature selection included demographics, comorbidities, home medications, vital signs. We constructed a logistic regression-based ML algorithm to predict "severe" COVID-19, defined as patients requiring intensive care unit (ICU) admission, invasive mechanical ventilation, or died in or out-of-hospital. Training data included 1,469 adult patients who tested positive for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) within 14 days of acute care. We performed: 1) temporal validation in 414 SARS-CoV-2 positive patients, 2) validation in a PUI set of 13,271 patients with symptomatic SARS-CoV-2 test during an acute care visit, and 3) real-time validation in 2,174 ED patients with PUI test or positive SARS-CoV-2 result. Subgroup analysis was conducted across race and gender to ensure equity in performance. RESULTS: The algorithm performed well on pre-implementation validations for predicting COVID-19 severity: 1) the temporal validation had an area under the receiver operating characteristic (AUROC) of 0.87 (95%-CI: 0.83, 0.91); 2) validation in the PUI population had an AUROC of 0.82 (95%-CI: 0.81, 0.83). The ED CDS system performed well in real-time with an AUROC of 0.85 (95%-CI, 0.83, 0.87). Zero patients in the lowest quintile developed "severe" COVID-19. Patients in the highest quintile developed "severe" COVID-19 in 33.2% of cases. The models performed without significant differences between genders and among race/ethnicities (all p-values > 0.05). CONCLUSION: A logistic regression model-based ML-enabled CDS can be developed, validated, and implemented with high performance across multiple hospitals while being equitable and maintaining performance in real-time validation.

Overcoming gaps: regional collaborative to optimize capacity management and predict length of stay of patients admitted with COVID-19.

OBJECTIVE: Ensuring an efficient response to COVID-19 requires a degree of inter-system coordination and capacity management coupled with an accurate assessment of hospital utilization including length of stay (LOS). We aimed to establish optimal practices in inter-system data sharing and LOS modeling to support patient care and regional hospital operations. MATERIALS AND METHODS: We completed a retrospective observational study of patients admitted with COVID-19 followed by 12-week prospective validation, involving 36 hospitals covering the upper Midwest. We developed a method for sharing de-identified patient data across systems for analysis. From this, we compared 3 approaches, generalized linear model (GLM) and random forest (RF), and aggregated system level averages to identify features associated with LOS. We compared model performance by area under the ROC curve (AUROC). RESULTS: A total of 2068 patients were included and used for model derivation and 597 patients for validation. LOS overall had a median of 5.0 days and mean of 8.2 days. Consistent predictors of LOS included age, critical illness, oxygen requirement, weight loss, and nursing home admission. In the validation cohort, the RF model (AUROC 0.890) and GLM model (AUROC 0.864) achieved good to excellent prediction of LOS, but only marginally better than system averages in practice. CONCLUSION: Regional sharing of patient data allowed for effective prediction of LOS across systems; however, this only provided marginal improvement over hospital averages at the aggregate level. A federated approach of sharing aggregated system capacity and average LOS will likely allow for effective capacity management at the regional level.

Responding to COVID-19 Through Interhospital Resource Coordination: A Mixed-Methods Evaluation.

OBJECTIVES: The COVID-19 pandemic stressed hospital operations, requiring rapid innovations to address rise in demand and specialized COVID-19 services while maintaining access to hospital-based care and facilitating expertise. We aimed to describe a novel hospital system approach to managing the COVID-19 pandemic, including multihospital coordination capability and transfer of COVID-19 patients to a single, dedicated hospital. METHODS: We included patients who tested positive for SARS-CoV-2 by polymerase chain reaction admitted to a 12-hospital network including a dedicated COVID-19 hospital. Our primary outcome was adherence to local guidelines, including admission risk stratification, anticoagulation, and dexamethasone treatment assessed by differences-in-differences analysis after guideline dissemination. We evaluated outcomes and health care worker satisfaction. Finally, we assessed barriers to safe transfer including transfer across different electronic health record systems. RESULTS: During the study, the system admitted a total of 1209 patients. Of these, 56.3% underwent transfer, supported by a physician-led System Operations Center. Patients who were transferred were older (P = 0.001) and had similar risk-adjusted mortality rates. Guideline adherence after dissemination was higher among patients who underwent transfer: admission risk stratification (P < 0.001), anticoagulation (P < 0.001), and dexamethasone administration (P = 0.003). Transfer across electronic health record systems was a perceived barrier to safety and reduced quality. Providers positively viewed our transfer approach. CONCLUSIONS: With standardized communication, interhospital transfers can be a safe and effective method of cohorting COVID-19 patients, are well received by health care providers, and have the potential to improve care quality.

Mass Critical Care Surge Response During COVID-19: Implementation of Contingency Strategies - A Preliminary Report of Findings From the Task Force for Mass Critical Care.

BACKGROUND: After the publication of a 2014 consensus statement regarding mass critical care during public health emergencies, much has been learned about surge responses and the care of overwhelming numbers of patients during the COVID-19 pandemic. Gaps in prior pandemic planning were identified and require modification in the midst of severe ongoing surges throughout the world. RESEARCH QUESTION: A subcommittee from The Task Force for Mass Critical Care (TFMCC) investigated the most recent COVID-19 publications coupled with TFMCC members anecdotal experience in order to formulate operational strategies to optimize contingency level care, and prevent crisis care circumstances associated with increased mortality. STUDY DESIGN AND METHODS: TFMCC adopted a modified version of established rapid guideline methodologies from the World Health Organization and the Guidelines International Network-McMaster Guideline Development Checklist. With a consensus development process incorporating expert opinion to define important questions and extract evidence, the TFMCC developed relevant pandemic surge suggestions in a structured manner, incorporating peer-reviewed literature, "gray" evidence from lay media sources, and anecdotal experiential evidence. RESULTS: Ten suggestions were identified regarding staffing, load-balancing, communication, and technology. Staffing models are suggested with resilience strategies to support critical care staff. ICU surge strategies and strain indicators are suggested to enhance ICU prioritization tactics to maintain contingency level care and to avoid crisis triage, with early transfer strategies to further load-balance care. We suggest that intensivists and hospitalists be engaged with the incident command structure to ensure two-way communication, situational awareness, and the use of technology to support critical care delivery and families of patients in ICUs. INTERPRETATION: A subcommittee from the TFMCC offers interim evidence-informed operational strategies to assist hospitals and communities to plan for and respond to surge capacity demands resulting from COVID-19.